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Cognition is embodied and walking is a crucial body movement 


For over a century, the investigation of human cognition has been mainly 
conducted in experiments with highly controlled sensory input in a stationary state, 
with maximal body movement suppression. Such carefully designed experiments 
played a crucial role in revealing the fundamental cognitive processes and underlying 
mechanisms, with confounding variables being controlled and high signal-to-noise 
ratio neural data being acquired. Notably, as suggested by embodied cognition, 
human cognitive processes are intricately linked with the interaction between the 
body and the environment (Byrge, Sporns, & Smith, 2014; Chiel & Beer, 1997; Wilson, 
2002). A very important way humans interact with the environment is through body 
movement. However, laboratory settings may fail to capture these interactions, 
therefore the role of body movement in cognition being largely overlooked. 


Among the numerous body movements, walking, in particular, has historically 
played a crucial role in validating mobile brain/body imaging (MoBI) techniques. 
These techniques were developed to address the challenges of recording EEG data 
during movement and have served as tests for signal processing approaches to 
correct the noise in EEG data recorded while subjects walked on a treadmill (Debener, 
Minow, Emkes, Gandras, & De Vos, 2012; Gramann, Gwin, Bigdely-Shamlo, Ferris, & 
Makeig, 2010). More importantly, walking is pervasive, complex, and highly 
functional. Failures in walking can have dire consequences, such as aging populations 
facing increased hospitalization risks and patients with locomotor disorders 
struggling to navigate and interact with their environment. In such a sense, walking 
is a fundamental activity that is integral to daily living, understanding the cognition 
during walking can provide insights into broader aspects of human cognition and 
brain function. 


Progress in walking-related research 
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One major area of research has focused on how the processing of visual and 
auditory cues influences kinematics, such as gait, stride, postural adjustments, and 
head-related patterns during walking (Burtan et al., 2021; Graci, Elliott, & Buckley, 
2009; Hiraoka, Kunimura, Oda, Kawasaki, & Sawaguchi, 2020; Jahn, Strupp, Schneider, 
Dieterich, & Brandt, 2001; Kao & Pierro, 2021). Some have also examined how 
auditory and visual information processing affects some cognitive processes during 
walking, such as obstacle avoidance, self-motion reproduction and speed estimation 
in and other navigation-related purposes (Jetzschke, Ernst, Froehlich, & Boeddeker, 
2017; Kolarik, Scarfe, Moore, & Pardhan, 2016; Muroi & Higuchi, 2017; Silva, Aravind, 
Sangani, & Lamontagne, 2018; Zanchi, Cuturi, Sandini, Gori, & Ferre, 2023). Those 
research, although did not directly measure the influence of walking on cognitive 
tasks, provided some hints of how certain types of information is processed or 
changed by walking: for instance, the finding showing that subjects exhibit more 
cautious behaviour, with decreased walking speed and step length when peripheral 
ecclusion vision was occluded using an eye-protective goggles suggests the 
importance of peripheral processing during walking (Graci, Elliott et al. 2009). 


Another line of study, which assessed the influence of body movement on 
cognitive processing drew more and more attention in the past 10 years (for reviews, 
see (Schmidt-Kassow & Kaiser, 2023; Stangl, Maoz, & Suthana, 2023). These studies 
usually employed a classic EEG dual-task methodology and compared the EEG 
response between a movement condition and a static condition. This line of research 
has revealed some interesting findings. One is that walking is associated with a 
decrease in the amplitude of both visual and auditory P300 compared to standing 
(Bradford, Lukos, Passaro, Ries, & Ferris, 2019; Chen, Cao, & Haendel, 2022; Gramann 
et al., 2010; Ladouce, Donaldson, Dudchenko, & letswaart, 2019). Traditionally, 
increased P300 amplitude may indicate enhanced attention or cognitive processing 
resources allocated to a task, while a decreased amplitude may suggest decreased 
attention or cognitive load. The reduced P300 amplitude was therefore considered as 
neural marker of reduced attention due to cognitive-motor interference. Another 
widely reported finding is that walking leads to reduced ongoing parietal-occipital 
ongoing alpha power compared to standing, which has been repeatedly reported 
independent of task feature and stimulus modalities (Cao, Chen, & Haendel, 2020; 
Cao & Handel, 2019; Chen et al., 2022; Delaux et al., 2021; Ehinger et al., 2014; Lin, 
Wang, & Jung, 2014). Alpha power has been well-documented as a reflection of 
functional inhibition, with low alpha activity being considered as a signature of 
regions engaged in active neuronal processing, whereas strong alpha oscillations 
reflect the inhibition and disengagement of task-irrelevant cortical areas (Jensen & 
Mazaheri, 2010; Klimesch, 2012).The reduction of alpha power due to walking 
therefore might indicate a changed attentional state during walking. Some 
researchers have also demonstrated that specific phases of walking can influence 
neural and behavioural responses, as well as eye movement patterns in a different 
way (Davidson, Verstraten, & Alais, 2024; Hollands, Marple-Horvat, Henkes, & Rowan, 
1995; Lajoie, Teasdale, Bard, & Fleury, 1993; Patla & Vickers, 2003). Overall, there 
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are some significant findings about how walking influences the cognitive processing, 
with quite some consistencies across modalities. These findings highlighted the 
importance of considering walking as a behavioural state in fully understanding 
human cognition. 


Multisensory processing during walking is not well-explored 


Despite the above-mentioned fruitful investigations directly or indirectly 
reflecting the cognitive processing during walking, both lines of studies only focused 
on only one individual modality, e.g. with task only including either visual or auditory 
task/stimuli. Relatively little work has been performed to explore how multisensory 
processes are integrated during walking. Even among those who have attempted to 
investigate multisensory processing during walking, the focus is to investigate 
whether one sensory modality is more important than another modality in affecting 
walking related activities. Vision has been found to be influential in avoiding obstacle 
and collisions, as well as alleviating split-belt locomotor adaptation effects, referring 
to the continuously adjustment of the timing and coordination of each limb by 
nervous system (Eikema et al., 2016; Kolarik et al., 2016; Silva et al., 2018). Some 
bodily sensations including vestibular, somatosensory, and proprioceptive inputs play 
crucial roles and can interact with visual processing to influence overall locomotor 
function (Cano Porras et al., 2020; Frissen, Campos, Souman, & Ernst, 2011). In some 
occasions, those sensations could dominate the cognitive processes during walking. 
Similarly, for audition, and tactile sensation, studies also still focused on how 
integrating perception of auditory and tactile stimuli influence walking-related 
patterns (Dollack, Perusquia-Hernandez, Kadone, & Suzuki, 2019; Eikema et al., 2016; 
Gupta, Kelty-Stephen, Mangalam, MckKindles, & Stirling, 2023; Jetzschke et al., 2017; 
Pitman, Sutherland, & Vallis, 2021). Majority of studies still just make interpretations 
based on how sensory process changes walking-related patterns, direct evidence of 
how the human during walking process the sensory input across modalities is lacking. 


Sensory processing between modalities might work in an integrated way as shown 
in animal models 


Research based on animal models have raised some interesting research 
discussions and questions regarding the multisensory processing during locomotion. 
There are animal studies showing that, unlike the facilitatory effect of locomotion on 
visual cortical responses (Niell and Stryker, 2010), the activity of auditory cortical 
neurons is suppressed (Schneider, Nelson, & Mooney, 2014; Schneider, Sundararajan, 
& Mooney, 2018; Yavorska & Wehr, 2021). This suppression has been observed in 
studies examining both auditory cortical neurons and simultaneous recordings of 
auditory and visual regions of the thalamus (Williamson, Hancock, Shinn- 
Cunningham, & Polley, 2015). Such suppression, however, was evidenced and 
discussed as not just simple inhibition of external sound or self-generated sound by 
feet, but a reflection of a neural resource allocation shifts from audition to vision 
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(Schneider et al., 2014; Zhou et al., 2014) and also as tradeoff with the emergence of 
explicit and reliable coding of locomotion velocity (Vivaldo, Lee, Shorkey, Keerthy, & 
Rothschild, 2023). One review has also suggested that the suppression observed in 
the processing of auditory information could be associated with the reallocation of 
processing resources away from acoustic input but toward somatosensory or visual 
cues when individual actively explores the environment (Lohse, Zimmer-Harwood, 
Dahmen, & King, 2022). Those animal work generally suggest that during locomotion, 
sensory processing in different modalities might work in an integrated way to aid for 
the perception, possibility due the limited resources. In an even broader sense, how 
an individual's sensory processing influenced by locomotion is likely the result of 
multiple factors being modulated and weighted together. It is worth noting that while 
recent studies suggest similar findings in humans, there was no conclusive evidence 
as animal studies. Overall, this highlights the need for systematic investigation into 
multisensory processing. 


Considering the cognition in human, in real world scenario, human almost do not 
walk while detecting something in a complete two-dimension panel, e.g. the screen 
in front, or an auditory information attached to ears in left or right. Instead, an often 
happen condition is to notice, reach or explore something actively while walking, 
multiple external sensory information can also interact with walking-generated visual, 
auditory and other body-related sensory input. From a fundamental science point of 
view, it is worth investigating whether walking negatively affects auditory behavioral 
task performance and neural responses to visual stimuli, as observed in animal 
studies. This question is closely related to how attention is allocated during walking. 
Practically, it is also relevant to real-world scenarios, such as how walking is allocated 
crossing a street or avoiding people and other obstacles. To answer these questions, 
it is crucial to understand how walking influences attention allocation dynamics and 
associated neural patterns. This area of research holds significant interest for future 
studies. 


To summarize, recent research has made significant progress in understanding 
how walking influences sensory processing in individual modalities. However, 
questions related to multisensory processing during walking remain numerous and 
are not yet well explored in humans. Future research should aim to investigate how 
multisensory information is integrated during walking, this line of inquiry is essential 
for advancing our understanding of human cognition in real-world scenarios. 
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